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Ti tel : Method for calibrating a camera-laser-unit in with 
respect to a calibration-object 

This application is the national stage of PCT/EP2004/09892 
filed on September 04, 2004 and also claims Paris Convention 
priority of EP 03023402 .5 filed on October 17, 2003 

BACKGROUND OF THE INVENTION 

Spec! f i ca t i on 

The present invention refers to a method for calibrating a 
camera-laser-unit j^ — with respect to at least one 
calibration-object disposed at a given position and 
orientation in a three-dimensional space. The camera-laser- 
unit comprises at least one laser (light-amplification by- 
stimulated emission of radiation) and at least one camera. 
The laser and the camera are disposed in a given distance 
with respect to one another. An optical axis of the laser and 
an optical axis of the camera include subtend a given angle. 
The camera-laser-unit is adapted to record the location, form 
and/or dimensions of a measurement-object. 

Furthermore, — trThe invention refers to also concerns a 
calibration-object used for calibrating a camera-laser-unit 
and disposed at a given position and orientation within a 
three-dimensional space. The camera-laser-unit comprises at 
least one laser and at least one camera. The laser and the 



camera are disposed •±tt — i at a given distance and an optical 
axis of the laser and an optical axis of the camera have 
subtend a given angle. The camera-laser-unit is adapted to 
record the location, form and/or dimensions of a measurement- 
object. 

Camera-laser-units of the kind mentioned above are well known 
in the state of the art. For example, such a camera-laser- 
unit is produced and sold by Perceptron, Inc., 47827 Halyard 
Drive, Plymouth, MI 48170, USA. Furthermore, such a camera- 
laser-unit and the use of such a unit is described in detail 
in the US-patents 4,645,348 and 6,166,811 both issued to 
Perceptron, Inc. A preferred embodiment of a camera-laser- 
unit of the kind mentioned above is described in detail in 
the German patent application 103 11 247, filed on March 14, 
2003 by the applicant of the present patent application. The 
publications of the two US-patents and of the German patent 
application are all included by hereby incorporated by 
reference into the present specification . 

According to the methods known in the art, calibration of a 
camera-laser-unit is very complex and time-consuming. To 
begin with^_ a first calibration-object has to be disposed ±rt 
with respect to the camera-laser-unit and the camera is 
calibrated with respect to the first calibration-object 
by, for example, making use of a Tsai algorith m, which is 
well known in the state of the art. Thereafter, a second 
calibration-object has to be disposed -in — with respect to the 
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camera-laser-unit and the laser is also calibrated in w ith 
respect to the second calibration-object? — too. 

The second conventional calibration-object in the state of 
the art typically comprises a planar object with an array of 
pins protruding from the plain plane . The pins represent a 
non-coplanar calibration-pattern used for calibrating the 
laser. The dimensions and distances of the pins are known. 
The problem is that the pins,_ when illuminated by the laser 
or any other light source^ form shadows on the adjacent pins, 
the shadows rendering very complicated and even impossible an 
accurate calibration of the laser. 

Therefore, it is known to make the pins retractable and to 
extract them one by one from the plain plane s of the cubic 
second calibration-object. After the extraction of each pin, 
a calibration routine is run and then the next pin is 
extracted with another calibration routine run thereafter, 
and so on. Thus, the calibration of the laser consists of 
numerous calibration routines. It may be well understood that 
in this way calibration of the laser is very cumbersome and 
requires a relatively long time. Typically, the calibration 
of the laser with the described method will take a couple of 
hours. Furthermore, the known calibration-method may be used 
only in laboratories or other places where the calibration 
assembly required for the calibration process may be build 
built up. It is certainly not qualified suited for 
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calibration of lasers during the intended use of the camera- 
laser-unit . 

One way for simplifying the calibration of the laser could be 
to reduce the number of pins. However, reducing the number of 
pins would reduce accuracy of the calibration. 

It is an object of the present invention to simplify the 
process of calibration of a camera-laser-unit without 
reducing the available associated accuracy. 

SUMMARY OF THE INVENTION 

This object is solved achieved by a method for calibrating a 
camera-laser-unit comprising the features of the independent 
method claim— t. In particular, a method of the above 
mentioned kind is suggested comprising the steps of: 

selecting a calibration-object comprising having at 
least two plain plane s disposed in a given angle with 
respect to each other and provided with a given non- 
coplanar calibration-pattern; 

disposing the calibration-object tt — with respect to 
the camera-laser-unit ins — at a given position and 
orientation in the three-dimensional space, wherein 
the orientation of the calibration-object is such 
that light emitted by the laser is visible on at 
least two plain plane s of the calibration-object; 
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calibrating the camera -am — with respect to the 
calibration-object using a Tsai algorithm; 
activating the laser 30 it to emite light visible on 
the at least two plain plane s of the calibration- 
object; 

recording the light on the plain plane s by the camera; 
determining the laser-properties from the light 
recorded by the camera; and 

calibrating the laser according to the determined 
laser-properties . 

It is a main aspect of the present invention that the same 
calibration-object is used for the calibration of the camera 
as well as for the calibration of the laser. Furthermore, 
after calibration of the camera -±rt ~ with respect to the 
calibration-object , the laser is calibrated -in — with respect 
to the (already calibrated) camera. With In other words, the 
camera is used for calibrating the laser. 

The whole procedure for calibrating a camera-laser-unit takes 
very little time and can be accomplished within a few 
seconds. This makes it the ideal procedure for calibration of 
a camera-laser-unit during its intended field use. For 
example, the application of the camera-laser-unit (recording 
the location, form and/or dimensions of a measurement-object) 
could be interrupted for a short period, an industrial robot 
carrying the camera-laser-unit could move the unit to the 
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calibration-object and dispose it in front of the object. 
Then the calibration process according to the present 
invention is run. Thereafter, the robot would move the 
camera-laser-unit away from the calibration-object back to 
the measurement-object and the intended use of the unit would 
be resumed* 

According to a preferred embodiment of the invention it is 
suggested that calibrating the laser comprises the step of 
defining a relative position and orientation of the laser ±rt 
with respect to a coordinate frame associated with the 
calibration-object, wherein the coordinate frame associated 
with the calibration-object is in a given position and 
orientation in the three-dimensional space. 

Concerning the calibration of the laser, it is suggested that 
the light emitted by the laser is visible on the 
plain plane s of the calibration-object as a line on 
each plain plane , the lines intersecting on a contact 
line of the two plain plane s; and 

the laser-properties are determined from the lines 
recorded by the camera by means of a line detection 
algorithm. 

Visible in the sense of the present invention means that the 
light emitted by the laser is visible to the camera. So this 
definition would comprise, for example, a case where the 
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laser emits infrared (IR) light, invisible to the human eye 
but visible to an IR camera. 

In other words, three points can be defined for the 
calibration of the laser, the two end points of the lines on 
the two plain p lane s of the calibration-object and the point 
of intersection of the two lines* 

Further, it is suggested that 

the light emitted by the laser is visible on the 
plain plane s of the calibration-object as a line on 
each plain p lane , the lines intersecting on a contact 
line of the two plain plane s; 

a laser- plain p lane is defined by the optical axis of 
the laser and the lines visible on the plain p lane s of 
the calibration-object; and 

in order to calibrate the laser according to the 
determined laser-properties, the position and 
orientation of the laser- plain plane s -in — with respect 
to a coordinate frame associated with the 
calibration-object is defined. 

Concerning the calibration of the camera it is suggested that 
the method comprises the step of defining a relative position 
and orientation of the camera ±n — with respect to a coordinate 
frame associated with the calibration-object, wherein the 
coordinate frame associated with the calibration-object is ±rt 
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at a given position and orientation in ^fehe— three-dimensional 
space . 

According to another embodiment of the present invention, -irt 
is suggested that a transformation matrix is define d in 
dependirtgence on the relative position and orientation of the 
camera -±rt — with respect to a coordinate frame associated with 
the calibration-object, the relative position and orientation 
of the laser ±n — with respect to a coordinate frame associated 
with the calibration-object, and optionally on internal 
camera parameters. The picture taken from the measurement- 
object by the camera is superposed or multiplied with the 
transformation matrix in order to obtain the actual location, 
form and/or dimensions of the measurement-object. 

According to yet another embodiment of the present invention, 
it is suggested that the camera-laser-unit to be calibrated 
is grasped by an industrial robot and disposed in respect to 
the calibration object in at a given position and 
orientation in the three-dimensional space with respect to 
the calibration-object , wherein the orientation of the 
camera-laser-unit is such that light emitted by the laser is 
visible on at least two plain plane s of the calibration- 
object . 

Furthermore, — fcThe object of the present invention is also 
solved achieved by a calibration-object of the above- 
mentioned kind characterized in that it comprises two 
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plain plane s disposed in at a given angle to each other, 
provided with a non-coplanar calibration-pattern on each 
plain plane comprising an array of features, and the 
calibration-object is used for calibration of the camera as 
well as for calibration of the laser. The array of features 
represents a grid of calibration points used for calibrating 
the camera as well as the laser of the camera-laser-unit. 

According to a preferred embodiment of the present invention^ 
it is suggested that the angle between the two plain p lane s is 
a right angle. The light emitted by the laser is visible on 
the plain p lane s of the calibration-object as a line on each 
plain p lane , the lines intersecting on a contact line of the 
two plain p lane s . In this way^_ the maximum possible volume in 
space can be calibrated. 

The features of the calibration-object may comprise have 
recesses, in particular cavities with a circular cross 
section, or prints on the plain p lane s of the calibration- 
object. The features may have any shape or design. For 
example, the features may comprise have rectangular recesses 
or prints with a square or a circular cross section , as 
viewed from above. The prints on the plain p lane s have a 
different color or a different surface than the p l ain plane s 
of the calibration-object, so that the features and the 
calibration pattern can be detected by the camera during the 
calibration process. 
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Further embodiments as well as further advantages of the 
present invention are outlined in the following description 
of the enclosed figures. 

BRIEF DESCRIPTION OF THE DRAWING 



Fig. 1 shows a schematic view of a preferred embodiment of 
a calibration setup for calibrating a camera-laser- 
unit according to the present invention; 

Fig. 2 shows a schematic view of a preferred embodiment of 
an assembly for recording the location, form and/or 
dimensions of a measurement-object by means of the 
calibrated camera-laser-unit; 

Fig. 3 shows a calibration setup for the camera-laser-unit 
in detail; 

Fig. 4 shows a flow chart of a preferred embodiment of a 
method for calibrating a camera-laser-unit 
according to the present invention; and 

Fig. 5 shows an example for a calibration-image. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 



The present invention refers to a camera-laser-unit for 
recording the location, form and/or dimensions of a 
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measurement-object. The camera-laser-unit shown in figure 2 
as a whole is designated with reference sign 1. It comprises 
mounting means 2 with a camera 3 and a light source 4, in 
particular a laser, mounted thereon. The laser 4 illuminates 
part of the measurement-object 5 and the camera 3 takes an 
image of the illuminated measurement-object 5. The camera 3 
comprises a CCD (charged coupled device) -chip 6 or other 
means (e.g. a CMOS-chip) for converting optical signals of 
the image into electrical signals for further processing 
within the camera-laser-unit 1. Furthermore, the camera 3 
comprises an optical system 7, in particular a lens, for 
reproducing the image on the CCD-chip 6. The camera 3 and the 
laser 4 are disposed on the mounting means 2 such that an 
optical axis 8 of the camera 3 intersects an optical axis 9 
of the laser 4 at a measurement point 10. The measurement 
point 10 is not necessarily disposed on a contact line 
between the two plain plane s 14, 15. Preferably the optical 
axis 8 and 9 are disposed in an angle a of 45 ° -i-ft — with 
respect to one another. The laser 4 generates a line 11 on 
the measurement object 5, which is recorded by the camera 3 
and reproduced on the CCD-chip 6 by the lens 7. 

For example, a camera-laser-unit of the mentioned kind is 
produced and sold by Perceptron, Inc., 47827 Halyard Drive, 
Plymouth, MI 48170, USA. Furthermore, such a camera-laser- 
unit and the use of such a unit is described in detail in the 
US-patents 4,645,348 and 6,166,811 both issued to Perceptron, 
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Inc. A preferred embodiment of a camera-laser-unit of the 
kind mentioned above is described in detail in the German 
patent application 103 11 247, filed on March 14, 2003 by the 
applicant of the present patent application. The publications 
of the two US-patents and of the German patent application 
are all included hereby incorporated by reference into the 
present specification, in particular for more detailed 
information on possible structures of camera-laser-units and 
on the process of determining the location, form and/or 
dimensions of a measurement-object by means of a camera- 
laser-unit . 

However, before the camera-laser-unit 1 can be used for 
recording the location, form and/or dimensions of a 
measurement-object 5, it has to be calibrated. During the 
calibration process the camera 3 and the laser 4 are put into 
relationship with the coordinates of a calibration-object 12 
(see figure 1) and a three-dimensional space 13, with the 

calibration-object 12 -±rs — being disposed at a given position 
and orientation within the three-dimensional space 13. In 
particular, camera parameters are determined and a relative 
position of one or more laser plain plane s is defined with 
respect to a coordinate frame 19 related to the calibration- 
object 12. A laser plain p lane is defined by the optical axis 
9 and the line 11 of light emitted by the laser 4 (see figure 
2 or 3) . Calibration of the camera-laser-unit 1 is necessary 
in order to allow the camera-laser-unit 1 to determine 
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absolute values for the location, form and/or dimensions of 
the measurement-object 5. 

Figure 3 shows the calibration-object 12 according to the 
present invention with its two plain plane s 14, 15 facing the 
camera-laser-unit 1. Any object 12 comprising two calibration 
plain p lane s 14, 15 is suitable for the calibration process 
according to the invention. A non-coplanar calibration- 
pattern comprising an array of recesses 17 is disposed on the 
two plain plane s 14, 15. Of course, the calibration-object 12 
can comprise an array of any kind of features, such as simple 
prints on the plain p lane s 14, 15 of any desired shape and 
cross section, instead of the recesses 17. 

In the embodiment shown in figure 3 the calibration-pattern 
comprises a six by six array of 36 grid-like disposed 
recesses 17 on each plain p lane 14, 15. Each recess 17 of the 
calibration-pattern is designed as a cavity having a circular 
cross section viewed from above. The same calibration-object 
12 is used for calibration of the camera 3 as well as for 
calibration of the laser 4. The two plain plane s 14, 15 are 
disposed din — at a known angle (3, preferably 90°. The closer to 
perpendicular the two plain plane s 14, 15 are, the larger is 
the volume over which the calibration is valid, so larger 
angles p could be used if volume is not a critical factor. 
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The present invention refers to a particularly advantageous 
process for calibrating the camera-laser-unit 1 ift — with 
respect to the calibration-object 12 disposed at a given 
position and orientation within the three-dimensional space 
13. The process comprises the following steps: 

Selecting a calibration-object 12 comprising at least 
two plain p lane s 14, 15 disposed ±r— at_a given angle p 
with respect to each other and provided with a given 
non-coplanar calibration-pattern (see figure 3) . 
Preferably, the angle p is 90° . 

Disposing the calibration-object 12 in respect to the 
camera laser unit 1 in at a given position and 
orientation in the— three-dimensional space 13 — with 
respect to the camera-laser-unit 1, wherein the 
orientation of the calibration-object 12 is such that 
light emitted by the laser 4 is visible for the 
camera 3 on at least two plain p lane s 14, 15 of the 
calibration-ob j ect 12 . 

In a first step, calibrating the camera 3 -in — with 
respect to the calibration-object 12 using a Tsai 
algorithm. The Tsai algorithm is well known for 
camera calibration. It is described in detail in M. 
Tapper, Ph. J. McKerrow, J. Abrantes : "Problems 
Encountered in the Implementation of Tsai's Algorithm 
for Camera Calibration", Proc. 2002 Australasian 
Conference on Robotics and Automation, Auckland, 27- 
29 November 2 002— j_ Concerning the camera calibration 
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by mean3 of a Tsai algorithm reference is made which 
to — is hereby incorporated by reference this document . 
In a second step calibrating the laser 4 in w ith 
respect to the (already calibrated) camera 3, and 
activating the laser 4 in order to make it emit light 
(line 11) visible as two lines 11a, lib on the two 
plain p lane s 14, 15 of the calibration-object 12, 
recording the light (lines 11a, lib) on the 
plain plane s 14, 15 by the camera 3 and reproducing 
the image (lines 16a, 16b) on the CCD-chip 6 by the 
camera lens 7, 

determining the laser-properties from the light 16 
recorded by the camera 3, and 

calibrating the laser 4 according to the determined 
laser-properties . 

The laser-properties are determined from the properties 
(length and angle y) of the lines 16a, 16b reproduced on the 
CCD-chip 6 of the already calibrated camera 3 by using a line 
detection algorithm. The two lines 11a, lib can be easily 
reconstructed in space from the images 16a, 16b using the 
camera parameters and the known geometry of the calibration 
object 12, Once the two three dimensional lines 11a, lib are 
determined, the information is adequate to reconstruct the 
laser plain plane (s) . 
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According to the present invention, calibration of the 

camera-laser-unit 1 is performed in two steps: 

First, standard camera calibration is performed to 
define the internal parameters of the camera 3 and 
the position of the camera 3 with reference to a 
coordinate system. 

Second, the position of the laser E^teir nplane (defined 
by the optical axis 9 and the line 11) is defined 
with reference to the same coordinate system. 

These two sets of parameters - camera parameters and laser 
plain plane equations - provide all the information necessary 
for performing projection and reconstruction using the 
camera-laser-unit 1 (e.g. transformation from image pixels 18 
of the CCD-chip 5 (see figure 3) into millimeters (mm) and 
vice versa. 

Making reference to the flow chart of figure 4, the method 
for calibrating the camera-laser-unit 1 according to the 
present invention will now be described in detail. The first 
step of the calibration process is to calibrate the camera 3 
(step 20) using an image 21 and the geometry 22 of the 
calibration object 12 and nominal camera parameters 23. The 
calibration of the camera is done by using a non-coplanar 
Tsai calibration algorithm. As a result of the camera 
calibration the camera parameters 24 are obtained. 
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The second step of the calibration process is to determine 
the laser plain p lane (s) (step 25) defined by the optical axis 
9 and the line 11 of light emitted by the laser 4. This can 
be accomplished by detecting the points belonging to the 
laser lines 11a, lib visible on the calibration-object 12. 
The laser line(s) 11a, lib are extracted (step 26) from the 
laser line image 27 taken by the camera 3. The geometry 22 of 
the calibration object 12, the camera parameters 24 and the 
extracted laser lines 26 are used for determining the laser 
plain p lane (s) 25, As a result of the determination of the 
laser pjr^ nplane s (s) the laser plain plane (s) 28 are obtained. 
Output 2 9 is calculated from the camera parameters 24 and the 
laser plain plane (s) 28. The output is, for example, a 
transformation matrix. 

Figure 5 shows an example for a calibration- image comprising 
two laser plain p lane s each with lines 11a and lib on the 
respective plain plane s 14 and 15 of the calibration object 12 
respectively . Provided that the scene illumination is not too 
bright (to avoid saturation) and that the surface of the 
calibration object 12 is not too reflective, the laser lines 
11a and lib can be easily distinguished. 

The detection of the laser lines 11a and lib comprises the 

following steps : 

Automatically defining or detecting the regions in 
the image recorded by the camera 3 covered by each 
plain plane 14, 15; 
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For each region: 

o scanning the region horizontally or vertically, 

depending on the relative positions of camera 3 and 
laser 4 and detecting the brightest pixel along 
each line or column. For multiple laser plain plane s 
(see figure 5) , multiple points can be detected, 
provided that some estimation for the minimum and 
maximum distance between the lines is known (in 
pixels) . This estimation can either be defined by 
the user, or calculated automatically from the 
angle between two adjacent laser plain p lane s and 
the calibration plain p lane s' 14, 15 positions. 

o For each detected pixel, detecting the center of 
intensity on its neighbourhood neighborhood , using 
the weighted average of pixel intensities. 

o For each laser plain plane , fitting a line on the 
detected points, using a linear regression 
algorithm. 

o Calculating the distance of each detected point 
from all detected lines 11a, lib. If the point is 
closer to some other line 11a, lib, then this point 
is misclassif ied, so it has to be moved to the 
correct set of points. 

One approach to define a laser plain plane once a pair of 
laser lines 11a, lib has been extracted (step 26), is to 
reconstruct the lines in three dimensional space, using the 
camera calibration parameters 2 4 and the plain plane equations 
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of the calibration plain p lane s 14, 15. The two reconstructed 
lines have adequate information to determine the olain plane 
of the laser 4 in the same coordinate system. A second 
approach that has proved to be more accurate, is to 
reconstruct all detected points (using the camera parameters 
24 and the equations of the calibration ptaiftplaries 14, 15), 
and iteratively fitting a plain plane to the reconstructed set 
of points, discarding at each step the most distant points. 
The position and orientation of the two plain plane s 14, 15 
can be easily defined with respect to a common coordinate 
system, e.g. centered at the point of intersection 10 of the 
two lines 11a, lib. 

As described above, calibration of a camera-laser-unit 1 with 
any number of laser plain p lane s can be performed using a 
three dimensional calibration-object 12, comprising at least 
two calibration plain plane s 14, 15. Of course, the complexity 
of the procedure would increase if objects 12 with more than 
two plain plane s were considered. The main advantages of the 
method according to the present invention are: 

The same camera model that is used for the 
calibration of the camera 3 can be used for the 
calibration of the laser 4 allowing a straight 
forward integration of the laser calibration into 
existing camera calibration processes. 
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Calibration of the camera 3 is performed by using an 
already existing, well known and highly tested Tsai- 
based algorithm and appropriate software. 
The topology of the calibration-object 12 is easy to 
construct with very high accuracy. 

High accuracy of calibration can be guaranteed over 
an entire volume covered by the calibration object 
12. 

The camera-laser-unit 1 can be easily and directly 
calibrated in any coordinate frame 19 (if the 
position of point of origin 0 of the frame 19 is 
known in the global coordinate frame 13) , without the 
need for time-consuming alignment processing. 



WE CLAIM: 
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Abstract 

The invention refers to a method for calibrating a camera- 
laser-unit (1) irn — with respect to at least one calibration- 
object (12) disposed at a given position and orientation in a 
three-dimensional space (13) . The camera-laser-unit (1) 
comprises a laser (4) and a camera (3), wherein the laser (4) 
and the camera (3) are disposed -ifl — at a given distance with 
respect to each other. An optical axis (9) of the laser (4) 
and an optical axis (8) of the camera (3) include subtend a 
given angle (a) .The camera-laser-unit (1) is adapted to 
record the location, form and/or dimensions of a measurement- 
object (5) . The method has the advantage that the same 
calibration-object (12) can be used for the calibration of 
the camera (3) and of the laser (4), wherein first the camera 
(3) is first calibrated using a Tsai-algorithm and then the 
laser (4) is calibrated m - with respect to^_ and by making use 
of^_ the already calibrated camera (3) . (Figure 1) 



